Skip to content

hrx: use the known row in Q6 tiled prefill - #188

Closed
AaronStGeorge wants to merge 1 commit into
users/astgeorg/row64-shared-f32-readerfrom
users/astgeorg/row64-q6-known-row
Closed

AaronStGeorge wants to merge 1 commit into
users/astgeorg/row64-shared-f32-readerfrom
users/astgeorg/row64-q6-known-row

Conversation

@AaronStGeorge

Copy link
Copy Markdown
Collaborator

Overview

Pass the known logical row from tiled prefill into Q6 row64 dequantization. This avoids reconstructing it from the standard-layout byte offset and retains the existing interface for other callers.

This is fix 2/5 in the row64 stack following #181. Stacks on #187; base branch: users/astgeorg/row64-shared-f32-reader. Commit: f3cd316c509f2dcc16beefe7b43d9624a8bc6749. Keep each fix as a separate stacked PR.

Validation

Clean committed build and seven focused controls passed, including the known-row fixture with an independent reference and route checks.

The complete stack at bd85479285423b239213519d0892c56d071864df was measured against frozen integration be335351871563a09520b0db4a63c21db2040807 with standalone llama-bench. The final fifteen-model table and separate Qwen3-0.6B stability result are in #181; those combined-stack results are not isolated gains from this commit.

Requirements

  • Contributing guidelines reviewed for this fork; human review and acceptance remain pending.
  • AI usage disclosure: YES. Codex assisted implementation, validation, independent review and this description under the user's direction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant